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A procedure is introduced which allows to represent the dynamics ol a non-equilibrium system 
violating detailed balance by its steady state loop fluxes as the 'states'. Surprisingly, this loop 
representation is found to obey detailed balance. A novel algorithm for the construction of the steady 
state probability densities naturally emerges, as well as a 'free energy' functional the minimization 
of which yields the densities and currents of the non-equilibrium steady state. 

PACS numbers: 89.75.Fb;05.70.Ln;05.65.-|-b 



It is one of the major open questions of physics whether 
there exists a general principle according to which sys- 
tems far from thermal equilibrium find their quasi- 
stationary states. While equilibrium systems simply seek 
the minimum of the free energy, an analogous functional 
governing non-equilibrium steady states (NESS) is not 
known. The search for such functional has been launched 
in the mid-twentieth century 0, H, 0] , but in spite of 
the many authors who have contributed to this demand- 
ing task (too many to be mentioned here, in fact), it has 
so far not been successful. The well-known major obsta- 
cle is the absence of detailed balance in most systems of 
practical relevance, i.e., the presence of non-trivial prob- 
ability currents in the NESS '^l. The present paper is not 
meant to add yet another trial to this list, but to point 
out a subtle structure which is common to a wide class 
of non-equilibrium systems, but appears to have been 
overlooked so far. More specifically, a procedure is intro- 
duced which transforms a system from a representation 
by its configurations into a representation in the space of 
all possible closed loops Q of probability flux. Surpris- 
ingly, detailed balance holds in this latter representation, 
providing a basis for defining a statistical potential in a 
quite conventional manner. This may turn out to be 
a useful link between equilibrium statistical physics and 
the dynamics of systems far from thermal equilibrium. 

Consider a system which can be in any one of N config- 
urations, Ci, with probabilities pi. The system is fully de- 
termined by the set of conditional probabilities a^r > 
to find the system in Cj at time t -\- t provided it was in 
Ci at time i, with a suitable (small) time step r. We then 
have fljj — The probability fluxes from state i 

to state j are 

cj)tj{t) = aijPi{t) (1) 

which implies that there is no memory of past transitions, 
i.e., the dynamics is considered a first-order Markov pro- 
cess. For most processes of physical interest, this can 
be achieved by proper definition of the states Ci. The 
temporal evolution of the probabilities is described by a 
master equation, 

^Y^iPjf^ji - Pi(^^J) (2) 
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The stationary solution of eq. ^ defines the set of steady 
state probabilities, P* :— {p,*} (the asterisk indicates 
steady state quantities throughout this paper). 

The description outlined above is widely used for a 
huge range of systems, including reaction-diffusion pro- 
cesses B,Tll , systems biology d, [13, El , cell migra- 
tion [l3|, trading market dynamics |14l . Il5l |. and many 
other classical non-equilibrium systems of general impor- 
tance For continuum systems, the Master equation 
is replaced by the Fokker-Planck equation, which can be 
obtained from eq. ^ by means of the Kramers-Moyal 
expansion. However, since the basic ideas of the present 
paper can be more clearly outlined using the discrete 
model, we will leave continuum descriptions to future 
work. 

In a system with detailed balance, all currents, jij :— 
— (jjji, vanish in the steady state, such that 

Pi^ij =P*jaji Vi, j (3) 

In this case, eq. ([3]) tells us that if one p* is known, the 
neighboring p* can be immediately obtained by multi- 
plying p* with the ratio of the corresponding transition 
rates, aij/aji. Continuing this procedure through the 
whole system, we can determine each of the probabil- 
ities, independently of the path we chose in doing so. 
This may be viewed as an integrability condition [l6|. 

The steady state density can then be derived from the 
potential [l7| 

:=-ln(no./n,o) (4) 

where Iloi is defined as the product of all rates a.y tra- 
versed in going step by step from a reference state, Co, 
to the state of consideration, Ci. We then have the sim- 
ple relation p* = M exp{—Ui) for all i, where TV is to be 
determined from the normalization condition, 

J2p^ = 1- (5) 

i 

However, in most systems of interest eq. ([3]) is not ful- 
filled. As a consequence, Ui as determined via eq. ^ 
would depend upon the path chosen for its evaluation. 
In other words, a potential in the above sense does not 
exist. 
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For the sake of clarity, we adopt a graph theoretical 
representation. Consider a graph G — {V,E), with ver- 
tices Vi G V, each of which corresponds to a configuration 
of the system, d. E is the set of directed edges, Cy, con- 
necting the vertices Vi and Vj. Each edge is associated 
with the corresponding rate, Oy . Note that we intrinsi- 
cally consider a maximal graph, in which exists for 
each pair (vi,Vj), although the corresponding rate con- 
stant, ay , may be zero for many edges. They may ac- 
tually be thought of as arbitrarily small but finite, in 
order to secure ergodicity, i.e., a unique NESS. We thus 
have \V\ = N, and \E\ = N'^, since the 'tadpoles' en are 
included as well. 

If eq ([3]) is not fulfilled, what we henceforth assume, 
there will be finite currents in the steady state. We prove 
that every stationary current, J* := can be repre- 

sented as a superposition of flux loops. By a flux loop 
C of length s we mean a set of s vertices and s directed 
edges which form a closed path which is self-avoiding, i.e., 
no vertex is visited twice. This assures that the number 
of possible loops, M, is finite provided G is finite. We 
find M — X^fLi N\/s{N — s)\ for the number of distinct 
self-avoiding loops which can be formed in G, and Sk 
is the number of steps of the loop Ck- To each loop we 
assign an intensity rn^ , which means that the correspond- 
ing loop contributes a flux of strength to each of the 
edges eij G Ek- We shall now prove that there exists 
at least one set of numbers {m^} such that the station- 
ary flux distribution, <&* , is equal to the superposition of 
loop fluxes with strengths nik- This entails the analogous 
(weaker) statement for the stationary current, J*, which 
is already known as the flow decomposition theorem . 

We begin by singling out one vertex, say, vq. The other 
A'^— 1 vertices are to be envisaged on a circle around it, or- 
dered according to their index, such that all edges ending 
or starting at vq are radial directed lines. Consider now 
the 'triloops' £f := ({wo, "fi, ^i+i}, {eoi, ei(i+i), e(i+i)o}) 
of length Si — 3. We first consider the loop £f = 
({wo,''^i,W2},{eoi, 612,620}) and set ml = c/)^^. This fully 
accounts for the flux (p^i, but also yields a contribution 
of to the edge 620- Next we consider the 'biloop' 
^2 = ({'^o, ■('2}, {602,620}) of length S2 = 2. Its strength 
shall be rij = 020 — </'oi 1 such that 4>2o = "nii + ^^2 is fully 
accounted for as well. Setting now = 0^2 ~ "-2 for the 
intensity of £| = ({wo, 1^2, W3}, {602, 623, 630}), we also ac- 
count for 0Q2J ^'^d so on. We continue in this way all 
around the circle, until we arrive at m^_]^. This corre- 
sponds to the last triangular loop which is left. Since <&* 
is by definition an equilibrium flux distribution, we know 
that Y.i{<t> oi ^ 'f'to) niust vanish. Furthermore, since the 
contribution of each loop into vq vanishes as well, this 
balance is not affected by the loops £| or £f . As a con- 
sequence, since 0j5i is already fully accounted for by ml, 
must he equal to m*j^_i, and n| = 0. This shows that 
all net fluxes to and from vq can be represented by a su- 
perposition of the triloop and biloop fluxes containing 

Vq. 

Now we remember all intensities m* and n* we have 



determined so far, and subtract the corresponding fluxes 
from <&*, such that there are no fluxes to or from vq 
left. All that remains are fluxes within the system V\vo. 
When subtracting the fluxes represented by the loops 
containing vq, we never violated the flux balance at any 
vertex, since all involved fluxes were loops, and therefore 
themselves balanced at each vertex. As a consequence, 
the field of fluxes in the truncated graph is again bal- 
anced, i.e., the sum of all fluxes to and from each ver- 
tex vanishes. We can then disregard the vertex vq, and 
proceed considering only the remaining truncated graph 
with N — 1 vertices. We single out one vertex again, and 
make all fluxes into it vanish by subtracting triloop and 
biloop fluxes, as described above. Note that we will not 
have to update any of the intensities of the flux loops 
containing vq, since vq (and thus all loops containing it) 
do not anymore belong to the system under study. 

This procedure can be repeated until a graph of just 
two nodes is left, which is of course a single biloop. We 
thus have constructed a set m^, such that the superpo- 
sition of the corresponding loop fluxes is equal to $*. 
This proves that every balanced flux field can be repre- 
sented by a superposition of triloop and biloop fluxes. A 
fortiori, it proves that <&* can be represented by a super- 
position of a set of any loop fluxes, without specifying 
their lengths, s^. It should be noted that we cannot as- 
sure that all loop intensities are positive. However, in all 
systems of relevance, the number of distinct loops, M, 
is much larger than the number of edges, N'^, such that 
the choice of the representing a certain <I>* is far from 
unique. In many (if not in all) cases, it will be possible to 
exploit this freedom to choose all non-negative p^ . 
We finally note that in a system with detailed balance, a 
trivial choice is to have only biloops, £|, with strengths 
m* =Ptatj =P*aj,. 

Next we make use of the graph representation to obtain 
a pictorial idea of the dynamics of the system. In the 
ensemble picture, we may imagine that the NESS consists 
of a very large number of actors travelling on the graph G 
step by step, each of which represents a realization of the 
system. Between the steps, actors reside at the vertices, 
and during each step (i.e., once each time interval r) 
each actor on a vertex, Vi, traverses one of its outgoing 
edges, Cij, according to the value of the corresponding 
rate constant, Oij. Choosing the edge en is to stay at 
this vertex for another time r. The fiuxes, 0y , just count 
the total number of actors traversing the edge Cij in one 
time step, not caring which realization they represent. 
Using the result obtained above, we may thus represent 
the the steady state fiuxes by imagining that each actor 
is eternally orbiting a single loop, Ck, with the number 
of actors on each loop being proportional to to^. More 
precisely, in the NESS each loop is occupied by ql := 
Skm*f. actors, having exactly actors on each of its Sk 
vertices. 

It is clear that in reality, the realizations of the system 
(i.e., the actors) will choose random continuations at each 
step instead of orbiting the loops. In other words, there 
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is a random exchange of actors between loops at each 
step. We may imagine each actor to carry a ticket for 
the loop he is currently orbiting. After each step, these 
tickets are exchanged randomly between actors at each 
vertex, such that the actors are redistributed among the 
loops, and thus among the outgoing edges of the respec- 
tive vertex. If this exchange is a microscopically balanced 
random process, what we will henceforth assume, it ful- 
fills detailed balance. This is the key idea of the 'flux 
loop transform' to be presented. 

Before we proceed, we define the functional xi^i^)^ 
where x is an object and X is a set of objects, by 



If we now require /({m^}) to be minimal under the 
constraints 0, ([5]), and (O, we directly obtain, by means 
of the Lagrange method, 

ml +^Xijx{eij,Ek) + ^ /iix(wi, T4) + lysk = Vfc 

ij i 

(11) 

where , /i^, and v are Lagrange multipliers. Combining 
eqs. d?]) and ([5]), we obtain 

^{x{e,j,Eu) - a^jx{v^,Vk))ml^{) (12) 



if X e X 
else 



(6) 



This allows for convenient bookkeeping of which vertex 
belongs to which loop. With the help of eq. ([6]), we can 
write 



and 



^mlx{e^j,Ek) Vi,j 



Pi ^^mlxiv^,Vk) Vi 



(7) 



(8) 



Inserting eq. ([TI]) into eq. ([T^ leads to N'^ equations for 
the set oi N'^ + N + 1 La. grange multipliers. The latter 
are thus still under-determined, although to a lesser de- 
gree than were the m^. For our choice of 7 = 2, however, 
/ just represents the distance to the origin in m*-space. 
Furthermore, the above equations for the ml are all lin- 
ear and thus define a hyperplane. Consequently, mini- 
mization of / under the above constraints just amounts 
to finding the point within a hyperplane which is closest 
to the origin (which is unique). The freedom in the La- 
grange multipliers thus defines a manifold within which 
the set of steady state intensities is invariant, and a solu- 
tion for ml is uniquely obtained from {atj} by the pro- 
cedure above. 

Once {ml} is known, the quantities characterizing the 
NESS, P* and the corresponding currents J* [l3|, can 
be computed directly from eqs. ([8]) and ([1]). Since all 
equations required to obtain {ml} have a particularly 
simple structure, and only contain the rate constants, 
this may be seen as an alternative procedure to find the 
steady state solution to any master equation, once the 
Qij are given. Its practical merits as compared to other 
techniques, such as inversion of the matrix of rate con- 
stants, (fly ), or the method of directed trees p7| . remain 
to be explored. Furthermore, it should be investigated 
For now, however, we are still faced with the inverse prob- if /({m*}) can be chosen such as to guarantee a set of 



Together with eq. ([5]) this leads to the normalization 
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Skm^. 



(9) 



By combining eqs. ([7|) and ([8]), we can express the tran- 
sition rates, , by the loop intensities as 



EfcKx(eij,-gfc) 
Ek'^lx{v^,Vk) 



(10) 



lem, which is to determine the M numbers ml from the 
just +N +1 equations d?]), dS]), and ©. 

This ambiguity may be greatly reduced by demanding 
the representation of the fluxes in the space of loops to be 
optimized in some sense, e.g., such as to prefer few large 
loops over many small ones. This can be achieved by in- 
troducing a 'penalty function', I{{ml}) := J2k di^k)^,*^? , 
where g{s) > and 7 can be chosen freely. This freedom 
of choice reflects the fundamental impact of the observer 
in defining convenient coarse-grained variables for char- 
acterizing a 'self-organized' state. I{{ml}) will be larger 
if more loops are used to represent a certain flux field. 
A g{s) which is strongly decreasing will favor long loops, 
and a large exponent 7 prevents too intense loop fluxes to 
appear. As we will see, the choice of g{s) and 7 will have 
no effect on the predictions we make on the NESS ac- 
quired by the system under study. As a particularly con- 
venient choice, we set g{s) = 1 and 7 = 2. One might as 
well employ a 1-norm, I{{ml}) := T^.i. Q(sk)\'mk\, \yhich 
leads to particularly few non-zero loop intensities |2C)I.|21|. 



non-negative ml . These questions will be addressed in a 
forthcoming paper. 

Let us finally turn to the flux loop transform. Consider 
a graph, H = {W,F), with vertices wt e W, each of 
which corresponds to a self-avoiding loop, Ck, in G. F 
is the set of directed edges, fki, connecting the vertices 
Wk and wi. To each vertex we assign the occupation 
number qk of the corresponding loop, and each edge is 
associated with a transfer rate constant, bki- We shall 
call the operation G — > H the loop transform. By virtue 
of eq. PH)) . its inverse exists and is unique. 

To investigate the properties of the transformed graph, 
H, we need to specify the numbers {bki}- The probability 
for an actor to transfer from loop Ck to loop Ci, at a 
certain vertex Vi (of G) which is common to Ck and Ci 
{vi € Vk n Vi) can be directly written down considering 
the ticket exchange process described above. It is 



''kl ^ 



Ek'"^*k'X{v^,Vk') p: 



-f (13) 
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Since each vertex which is common to both loops yields 
an independent chance to transfer from Cy^ to Ci, the 
total probability to do so is 

tki = Vk n Vi) - Ckm*i (14) 

i 

where Cm ■= J2iX{v2,Vk n Vi)/p*. On the other hand, 
since the probability for an actor on loop Ck to be at 
a certain vertex i is l/sk, the rate constant for transfer 
from Ck to Ci is given by bki = tu/sk- Since evidently 
Cki = Cik , it is clear from eq. (|14p that 

9fe^fci = qthk (15) 

which states that there is detailed balance in H . We can 
thus apply eq. ([4]) , replacing by fe/ci , to obtain a poten- 
tial Hk, such that the occupation numbers ql are given 
by 

ql = cM-Hk) (16) 

Note that J2k exp(— H^) = 1 by normahzation, eq dH). 

There is still a disfigurement in using H to repre- 
sent the system under study. Since H concerns only 
loop fluxes, all possible densities Q — {qk} represent 
flux fields $ (in G) which are balanced at each vertex, 
and thus yield a time-independent density field, P. This 
does clearly not fulfill the master equation ^ in gen- 
eral, which shows that any dynamics in H, away from 
the steady state, has nothing to do physically with the 
dynamics in G as described by eq. ([2|). It is so far only 
the equilibrium state of H which has a physical meaning, 
namely to represent the NESS in G. 

This can be amended, however, by alleviating the re- 
quirement that the qk actors on a loop Ck be evenly dis- 
tributed among it vertices, as is the case in the steady 
state. In what follows, we thus distinguish between the 
occupation numbers qk,i at the different vertices Vi along 
the loop Ck- The relation J2i qk,i = Skruk = qk is fulfilled 
by definition. Furthermore, we slightly change the rule 
for the random redistribution of the tickets introduced 
above such that between any two time steps, all actors 
at each vertex give their tickets away, and draw new ones 
with a probability according to the corresponding equi- 
librium intensities, m*j,/p*. In the steady state, this rule 
yields identical results as the one before, but assures the 
correct dynamics away from the NESS. Any distribution 
P = {pi\ can then be uniquely represented setting 

qk,t ^ ^mlxiv^Vk) (17) 



It should be noted that the temporal evolution of the 
qk,i{t) in H does not simply obey a Master equation anal- 
ogous to eq. ([2|). But the the dynamics of the system is, 
by means of the flux loop transform, presented such that 
all violations of detailed balance are concealed within the 
('interior degrees of freedom' of the) vertices of H . As 
time proceeds, not only will the vrik approach their equi- 
librium values, but also will the occupation numbers of 
the different vertices corresponding to the same loop ap- 
proach each other (g^ ,- = = ql/sk)- 

Remembering that the qk — J2i qk,i approach the 
Boltzmann distribution (fT6|) . we see that the system as 
represented in H is in some sense analogous to a classi- 
cal system having M discrete levels at energies Wfc := 
Tik + Insfc, each of which is Sfe-fold degenerate. The 
only difference is that in 7?, the qk,i perform a 'round- 
dance' within each energy level (i.e., in the vertices of 
H), which becomes insignificant as the steady state is 
reached. There is thus no physical manifestation of the 
violations of detailed balance in the NESS as represented 
in H. 

Finally, we may write down an entropy in H as 

5(<) = -^<7fe,an<7fc,, (18) 

which depends on time via the qk^i if the system is started 
away from the NESS. The latter will maximize iS while 
obeying Defining thus W := qk^k, it is readily 
checked that minimizing 

T=W-S = y2qk,^\n^ (19) 

k,i ^ 

which is very much reminiscent to a usual free en- 
ergy functional, yields precisely the NESS, i.e., the pair 
{P*, J*} It may thus be hoped that the loop trans- 
form outlined above opens up the possibility to apply 
standard equilibrium statistics formalism to a wide class 
of systems far from thermal equilibrium. 

The author is indebted to Jiirgen VoUmer, Vasily 
Zaburdaev, Manfred Denker, Folkert Miiller-Hoissen, 
Martin Brinkmann, Barbara Drossel, and Axel Fingerle 
for inspiring discussions and numerous helpful hints. 
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